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system, the speech decoding engine and the speech synthesizing engine; and (F) at least one^er 
interface data set operatively coupled to the dialog manager, the user interface data set representing 
spoken language interface elements and data recognizable by the application of the device; wherein: 
(i) the dialog manager enables connection between the input audio system and t|ie speech decoding 
engine such that the spoken utterance provided by the user is provided from/fhe input audio system 
to the speech decoding engine; (ii) the output generated by the speech ^jiecoding engine is returned 
to the dialog manager; (iii) the dialog manager uses the output gprferated by the speech decoding 
engine to search the user interface data set for a corresponding'spoken language interface element 
and data which is returned to the dialog manager when fotfnd; (iv) the dialog manager provides the 
spoken language interface element associated data to,tfie application of the device for processing in 
accordance therewith; (v) the application of the'device, on processing that element, provides a 
reference to an interface element to be spoken; (vi) the dialog manager enables connection between 
the audio output system and the speech^nthesizing engine such that the speech synthesizing engine 
which, accepting data from that element, generates a synthesized output that expresses that element; 
and (vii) the audio output sysjem audibly presenting the synthesized output to the user; a method for 
modifying a data structure containing the at least one user interface data set, comprising: 
adchrtg a new application to the device; 

generating a second user interface data set in accordance with the new application, 
the^econd user interface data set representing spoken language interface elements and data 
'recognizable by the new application; 

transferring the second user interface data set from the device to the apparatus; and 
loading the second user interface data set into the data structure of the apparatus. 
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18. (Amended) The apparatus of claim 16, wherein the portable spoken lam 

device comprises a personal speech assistant (PSA), the PSAj^mpTising: 

^jj^ an audio input system forjeceivmg^peech data provided by the user; 

an audio outpuLsygtem for outputting speech data to the user; 

decoding engine for generating an output in response to spoken utterances; 

2 



feech i 



Application Serial No. 09/460,913 

a speech synthesizing engine for generating a synthesized speech output in response \^ 

to text data; 

a dialog manager operatively coupled to the device, the audio input system, th^audio 
output system, the speech decoding engine and the speech synthesizing engine; and 

at least one user interface data set operatively coupled to the dialog manager, the user 
interface data set representing spoken language interface elements and data^ecognizable by the 
application of the device; 

wherein: 

the dialog manager enables connection beHveen the input audio system and 
the speech decoding engine such that the spoken utt^ptoce provided by the user is provided 
from the input audio system to the speech decoding engine; 

the output generated by the speech decoding engine is returned to the dialog 

manager; 

the dialog manager u^s the output generated by the speech decoding engine 
to search the user interface data^get for a corresponding spoken language interface element 
and data which is returned te^ the dialog manager when found; 

the dialogroanager provides the spoken language interface element associated 
data to the applicatipri of the device for processing in accordance therewith; 

ttre application of the device, on processing that element, provides a reference 
to an interfa*z6 element to be spoken; 

the dialog manager enables connection between the audio output system and 
the speech synthesizing engine such that the speech synthesizing engine which, accepting 
!a from that element, generates a synthesized output that expresses that element; and 

the audio output system audibly presents the synthesized output to the user. 
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